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with  Officer's.   However,  the  "risk  premium"  variable  (one  not  con- 
sidered by  Officer)  shows  significant  positive  correlations  with  the 
volatility  variable  in  every  subperiod. 

Effect  of  Institutional  Trading.   Legislation  restricting  the  freedom 
of  large  institutions  to  actively  trade  in  the  capital  markets  is  a 
real  possibility  when  the  belief  exists  that  increased  institutional 
trading  in  the  stock  market  leads  to  an  increase  in  market  return 
volatility.   The  empirical  evidence  provided  in  this  study,  however, 
does  not  indicate  that  institutions  are  the  cause  of  any  increase  in 
market  return  volatility.   In  fact,  the  significant  negative  relation- 
ships indicate  that  an  increase  in  institutional  trading  is  related 
to  a  decline  in  market  return  volatility.   Thus,  it  seems  that  insti- 
tutional trading  provides  liquidity  for  the  total  market.   In  addition, 
we  found  significant  positive  correlations  between  institution  purchases 
and  sales  which  implies  that  institutions  are  providing  liquidity  for 
one  another. 

Given  such  conclusions,  there  is  no  justification  for  attempting 
to  restrict  trading  by  financial  institutions.   In  fact,  such  restric- 
tions could  lead  to  an  increase  in  market  return  volatility  because 
restrictions  would,  by  definition,  reduce  institutional  trading  activ- 
ity and  the  liquidity  available  for  all  market  participants. 
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Sinmnary: 

This  paper  deals  with  an  investor  loss  function  for  earnings  forecasts. 
Specifically  we  develop  a  theoretical  framework  that  measures  loss  in  the 
context  of  the  problem  of  resource  allocation  under  uncertainty.   The  frame- 
work maps  a  set  of  forecasts  into  an  expected  return.   This  expected  return 
is  compared  to  that  return  which  could  be  expected  given  perfect  knowledge 
of  future  earnings  and  the  resulting  difference  measures  the  investor's  loss. 
Some  empirical  results  are  given. 


This  paper  deals  with  an  investor  loss  function  for  earnings  fore- 
casts.  Specifically  we  develop  a  theoretical  framework  that  measures  loss 
in  the  context  of  the  problem  of  resource  allocation  under  uncertainty. 
The  framework  maps  a  set  of  forecasts  into  an  expected  return.  This  ex- 
pected return  is  compared  to  that  return  which  could  be  expected  given 
perfect  knowledge  of  future  earnings  and  the  resulting  difference  mea- 
sures the  Investor's  loss. 

The  need  for  a  loss  function  arises  from  the  need  of  investors  to 
assess  the  value  of  alternative  sources  of  forecasts.  In  addition  empiri- 
cal research  studies  have  often  compared  various  forecast  models.  The 
typical  approach  has  been  to  compare  forecast  accuracy  or  dispersion. 
This  approach,  however,  is  limited.  For  example  Foster  [1977,  p.  10] 
stated  "It  is  important  to  recognize  that  our  measures  of  dispersion 
are  essentially  surrogate  criteria  for  evaluating  alternative  forecast- 
ing models.  A  more  complete  analysis  T-rould  specify  the  loss  function  in 
a  specific  decision  context."  In  addition  Gonedes  et  al  [1976,  p.  94] 
wrote,  "There  is  a  more  fundamental  deficiency  in  these  prediction  per- 
formance studies....  Specifically  they  are  not  based  upon  any  explicit 
theoretical  structure  that  connects  their  frameworks  to  resource  allo- 
cation under  uncertainty." 

The  purpose  of  the  present  study  is  to  develop  a  theoretical  frame- 
work to  overcome  these  limitations.  This  framework  takes  the  form  of  an 
investor  loss  function  (henceforth  ILF) .  A  secondary  purpose  is  to  em- 
pirically apply  the  ILF  for  purposes  of  comparing  forecasts  generated 
from  several  models  that  have  recently  been  employed  in  the  literature. 
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The  paper  is  in  four  parts.  Part  one  discusses  some  of  the  Issues 
associated  with  an  ILF,  part  two  presents  an  operational  form  of  the 
ILF,  part  three  is  an  empirical  application  and  part  four  contains  sum:- 
inary  and  conclusions. 

BACKGROUin)  ISSUES 
An  important  result  of  research  on  the  information  content  of  ac- 
counting earnings  is  that  ex  ante  knowledge  of  annual  earnings  can  provide 
an  opportunity  for  an  investor  to  earn  an  abnormal  return.  For  example. 
Ball  and  Brown  [1968]  reported  that  if  one  were  to  know  the  sign  of  the 
unexpected  annual  earnings  change  12  months  in  advance  it  would  be  possible 
to  earn  a  7%  abnormal  return  via  a  simple  trading  rule.  These  findings 
pose  some  Interesting  questions  with  respect  to  earnings  forecasts. 

1)  If  the  market  is  efficient,  then  we  wouldn't  expect  a  forecast 
model  to  enable  an  individual  to  earn  an  abnormal  return  via 
utilizing  only  publically  available  information. 

2)  If  the  expectation  in  (1)  is  correct,  then  from  the  individual 
investors  standpoint  the  problem  of  comparing  various  sets  of 
forecasts  might  become  irrelevant.  One  could  expect  to  earn 
no  better  than  the  risk  conditioned  rate  of  return  since  the 
risk-return  relationship  should  not  depend  on  the  portfolio 
selection  process. 

3)  Looking  at  (2)  from  another  side,  we  would  not  expect  a  return 
less  than  the  risk  conditioned  return  via  the  same  reasoning. 

Given  the  above  reasoning,  it  might  seem  that  investors  would  only 
be  concerned  with  constructing  minimum  variance  portfolios  and  would  not 
be  concerned  with  using  earnings  forecasts  in  their  decision  models.  Re- 
search, however,  points  to  the  exact  opposite.  For  example,  Nordby  [1973] 
found  that  99%  of  responding  analysts  claimed  that  they  use  earnings 
forecasts  in  their  decision  making  process. 

What  then  accounts  for  the  extensive  use  of  forecasts  in  practice? 
The  answer  seemingly  must  be  one  of  two  things: 
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(1)  Some  individuals  do  earn  an  abnormal  return  and  the  market 
is  not  efficient. 

(2)  Some  individuals  think  that  they  can  earn  an  abnormal  return, 
but  the  market  is  efficient  and  they  are  possibly  irrationally 
allocating  resources  for  purposes  of  obtaining  forecasts. 

Research  and  reasoning  can  be  used  to  support  both  (1)  and  (2) ,  A 
large  amount  of  research  has  been  conducted  which  favors  efficiency.  On 
the  other  hand  there  is  evidence  which  is  not  consistent  with  efficiency. 
A  good  example  of  this  is  the  Value  Line  Investment  survey.  Black  [1973] 
found  reasonably  strong  evidence  that  the  survey  is  able  to  predict  returns 
of  securities  in  a  way  that  cannot  be  accounted  for  by  differences  in  risk. 
(Note  that  the  survey  relies  heavily  on  a  determination  of  "earnings 
momentum".)  In  addition,  Joy  et  al  [1977,  p.  207]  presented  evidence  that, 
"...the  information  contained  in  quarterly  earnings  was  not  fully  impounded 
into  stock  prices  at  the  time  of  announcement." 

It  is  not  the  purpose  of  the  present  paper  to  take  a  position  on  effi- 
ciency or  lack  of  efficiency  in  the  market.  However  it  must  be  noted 
that  the  theory  of  market  efficiency  does  not  explain  the  empirically 
observed  behavior  of  users  of  earnings  forecasts.  An  alternative  frame- 
work which  might  explain  such  behavior  is  that  of  Grossman  emd  Stiglitz 
[1976]  who  pointed  out  that  costless  information  is  not  only  sufficient 
for  market  efficiency  but  necessary  as  well.  Their  alternative  is  sum- 
marized (p.  218): 

In  the  structure  we  have  developed,  the  market  never 
ftilly  adjusts.  Prices  never  fully  reflect  all  the 
information  possessed  by  the  informed  individuals. 
Capital  markets  are  not  efficient,  but  the  difference 
is  just  enough  to  provide  the  revenue  required  to  com^ 
pensate  the  informed  for  purchasing  the  information. 

Note  that  this  framework  allows  for  the  possibility  that  there  is  a  value 

of  gathering  information  and  therefore  a  corresponding  loss  for  gathering 
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infonnation  which  is  less  than  optimal.   Stated  differently,  an  "abnormal" 
return  must  be  earned  to  cover  the  cost  of  information  production  and 
to  the  degree  that  an  abnormal  return  is  not  earned  there  is,  in  a  sense, 
a  loss.  It  is  this  loss  that  is  the  focus  of  the  study. 

If  the  market  is  assumed  to  be  efficient  and  the  market's  earnings 
expectation  model  is  assumed  to  be  optimal,  then  one  might  gauge  the  use- 
fulness of  a  given  forecast  method  by  measuring  the  abnormal  returns 
associated  with  an  investment  strategy  based  on  an  e:;  ante  knowledge  of 
the  forecast  error  (i.e.,  unexpected  earnings)  of  the  given  model.  This 
statement  is  elaborated  on  by  Brown  and  Kennelly  [1972,  p.  404]: 

This  experimental  design  permits  a  direct  comparison 
between  alternative  forecasting  rules. .. .The. . .conten- 
tion is  based  on  the  hypothesis  (and  evidence)  that  the 
stock  market  is  "both  efficient  and  unbiased  in  that, 
if  information  is  useful  in  forming  capital  asset 
prices,  then  the  market  will  adjust  asset  prices  to 
that  information  quickly  and  without  leaving  any 
opportunity  for  further  abnormal  gain"  (Ball  and  Brown, 
1968).  There  is,  then  a  presumption  that  the  con- 
sensus of  the  market  reflects,  at  any  point,  an  esti- 
mate of  future  EPS  which  is  the  best  possible  from 
generally  available  data.  Since  the  abnormal  rate 
of  return  measures  the  extent  to  which  the  market  has 
reacted  to  errors  in  its  previous  expectations,  the 
abnormal  rate  of  return  can  be  used  to  assess  the 
predictive  accuracy  of  any  device  which  attempts  to 
forecast  a  number  that  is  relevant  to  investors.  To 
our  knowledge.  Ball  and  Brown  (1968)  were  the  first 
to  make  use  of  this  fact. 

This  basic  type  of  reasoning  can  be  used  to  derive  several  types 

of  empirical  tests  all  based  on  different  sets  of  assximptions  as  listed 

below. 
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Category      Assuaptlons  Test 

1  A)   Efficient  narket        Compare 

B)   Earnings  has  infor-      Prediction  models  on 

mation  content         ability  to  approximate  assianed 

optimal  market  prediction  model 

2  A)   Efficient  market 

B)   Given  prediction        Information  content 
model  approximates 
market  model 

3  A)   Efficient  market        Joint  test  of 

information  content 
and  prediction  model 


Most  of  the  acco;mting  research  has  fallen  in  one  of  the  above 
three  categories.  For  example  Foster's  [1977]  study  on  quarterly 
accounting  data  falls  into  category  1  while  Ball  and  Brown  [1968]  and 
Brown  and  Kennelly  [1972]  among  many  others  fall  into  category  2.  It 
can  be  argued  also  that  categories  1  and  2  are  subsumed  vinder  category  3 
which  reduces  to  the  first  two  cases  to  the  degree  that  the  assianptions 
are  correct.  In  the  present  study  we  develop  a  methodology  (ILF)  for 
comparing  prediction  methods  which  do  not  rely  on  any  of  the  Table  1 
assumptions.  Instead  we  assume  that  there  exists  some  market  expectation 
(prediction)  for  earnings  (not  necessarily  optimal)  and  a  corresponding 
unanticipated  earnings  figure.  From  an  investor's  standpoint  it  is  of 
interest  to  predict  this  unanticipated  change  in  earnings,  since  given 
knowledge  of  the  imanticipated  earnings  change,  he  can  formulate  an  in- 
vestment strategy  which  will  produce  an  abnormal  return  as  measured  by 
the  market  model.  We  define  the  investor's  loss  to  be  the  difference  be- 
tween the  return  that  he  would  earn  given  the  perfect  knowledge  of  the 
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unexpected  earnings  and  that  return  which  he  would  earn  based  on  utilizing 
his  prediction  of  the  unanticipated  earnings  number*  This  definition 
is  opera tionalized  below  and  applied  to  a  comparison  of  several  forecast 
methods  found  in  the  literature. 

It  should  be  emphasized  that  in  developing  the  loss  function  we  are 
not  concerned  with  market  efficiency  per  se  but  rather  an  individual  in- 
vestor's perceptions  with  respect  to  market  efficiency.  In  particular  we 
assume  that  the  investor  believes  that  there  is  a  possibility  of  earning 
a  return  higher  than  predicted  by  the  Sharp-Lintner  [1964,  1965]  capital 
asset  pricing  model.  As  pointed  out  previously,  unless  this  assumption 
holds,  there  is  no  private  value  of  the  earnings  forecast  based  on 
publicly  available  information.  If  there  is  no  private  value,  then  from 
the  individual's  standpoint  the  process  of  comparing  forecasts  is  dubious. 
It  is  also  pointed  out  that  the  loss  function  derived  in  this  paper  does 
not  depend  on  the  need  to  compare  forecast  methods  but  simply  specifies 
the  loss  associated  with  different  forecast  sources.  If  there  is  no  need 
to  compare  forecast  methods,  then  all  forecast  methods  should  have  eqtial 
loss.  This  is  an  empirical  question. 

OPEEATIONALIZATION  OF  THE  ILF 
In  order  to  use  the  ILF,  it  is  first  necessary  to  operationally  define 
a  market  expectation  model.  In  this  study  we  use  the  cross-sectional  model 
employed  by  Ball  and  Brown  [1968]  which  regresses  individual  firms'  earnings 
changes  on  market  earnings  changes.  We  use  this  model  since  Ball  and  Brown 
observed  that  ex  ante  knowledge  of  its  residuals  made  it  possible  for  an 
investor  to  earn  a  7%  abnormal  return. 
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To  facilitate  operationalization  of  the  loss  function  we  make  the 
following  definitions: 
CD  F.^ 

0 

(2)  E(A.^)  =a^,  +  b^^  Z  A 

J=l 

N 

(3)  E(F   )  =  a   +  b    (  S  F   ) 

itQ  il  11  .^^       jtQ 

1-4-  1- 

(4)  ELlnCUR^^  -  R^^)]  =  b^^  l^C^^^it  "  ^ft^ 
Where: 

(A)  F    represents  the  investor's  expectation  of  earnings  change 
forOfirm  i  and  period  t.  This  expectation  could  be  the  result 
of  intuition,  statistical  modeling  or  judgmental  opinion. 

(B)  (2)  is  an  empirical  description  of  the  relationship  between 
market  and  firm  earnings  changes.   The  coefficients  a  .  and 

b^  .  are  assumed  to  be  known  by  investor.   Note  that  trie  inves- 
tor is  asstuned  to  use  the  same  coefficients  in  (3) .   Also  the 
subscript  t  denotes  time  previous  to  t  .   (In  the  empirical 
application,  a^ .  and  b^  .  are  estimated  by  regression  on 
previous  years  data.) 

(C)  E(F   )  represents  the  investor's  expectation  of  earnings  changes 
(A.  9   for  firm  i  in  period  t„  conditioned  upon  his  expectation 
of  tBe  market  earnings  period  t  .   Since  this  depends  on  F 
(which  is  ex  ante),  it  is  ex  ante.  0 

(D)  E(R  )  is  the  Sharp-Lintner  [1964,  1965]  capital  asset  pricing 
model  where  R   represents  the  return  on  asset  i  in  period  t, 
R   represents  the  market  return  in  period  t  and  R^  is  the 
risk  free  rate  of  return. 

Given  the  above  definitions  we  can  define  the  investor's  anticipation 

of  the  unexpected  change  in  earnings.   It  is  this  unexpected  change  which 

Ball  and  Brown  [1968]  found  to  enable  one  to  earn  an  abnormal  return  when 

known  in  advance.  We  proceed  to  define  the  investor's  anticipation  of  the 

unexpected  changes  in  earnings  subtracting  (2)  from  (1) : 
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^^0      0       0 

When  a    is  greater  than  zero,  then  the  investor  expects  a  positive 
0 
unexpected  change  in  earnings.  When  a.   is  less  than  zero,  a  negative 

^0 
unexpected  change  is  anticipated.  This  is  consistent  with  the  Ball 

and  Brown  market  conditioned  definition  of  unanticipated  change  in 

earnings  except  it  is  based  on  predicted  earnings  as  opposed  to  actual 

earnings . 

Given  that  a    is  positive  (negative),  the  investor  would  be  expected 

to  buy  long  (sell  short)  in  asset  i.  Also  to  the  degree  that  his  expectations 

are  correct,  he  will  earn  an  abnormal  return  which  will  be  denoted  nota- 

tionally  as  AIL,.   Similarly  let  AR^  represent  the  abnormal  return  assviming 

that  investor  has  perfect  knowledge  of  the  future  earnings  (i.e.,  his 

predictions  of  all  firms  are  perfectly  accurate) .  Then  define  the 

investors  loss  function  (ILF)  as 

(6)   ILF  =  ARpp  -  ARj, 

Where  ILF  has  the  intuitive  interpretation  as  being  the  loss  incurred 
from  not  having  perfect  forecasts.  The  minimum  expected  value  is  expected 
to  be  0  in  the  case  of  having  perfect  forecasts,  and  equal  to  the  abnormal 
return  of  having  perfect  forecasts  in  the  case  of  having  useless  forecasts. 

EMPIRICAL  APPLICATION 
Forecast  Models 

The  empirical  results  of  this  study  focus  on  the  ability  of  several 
statistical  models  to  predict  annual  EPS  from  qviarterly  EPS.  This  purpose 
has  been  suggested  by  the  Financial  Accounting  Standards  Board  in  the 
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discussion  memorandum.  Interim  Financial  Accounting  and  Reporting  (FASB, 
1978) .   In  addition  there  has  been  a  considerable  amount  of  research 
done  on  the  predictive  ability  of  models  using  quarterly  EPS  (e.g., 
Lorek,  1979;  Foster,  1977;  Brown  and  Rozeff,  1978), 

We  focus  on  several  models  that  have  been  given  considerable  atten- 
tion with  respect  to  their  ability  to  represent  the  time  series  of 
quarterly  EPS.  These  are 

1)  a  seasonally  and  consecutively  differenced  first  order  and 
seasonal  moving  average  model  [Griffin,  1977;  Watts,  1975] 

2)  a  seasonally  differenced  first  order  autoregression  model 

2 
with  a  constant  drift  term  [Foster,  1977] 

3)  a  seasonally  differenced  first  order  autoregressive  and 
seasonal  moving  average  model  [Brown  and  Rozeff,  1978] 

4)  firm  identified  and  estimated  Box- Jenkins  models. 

In  the  Box-Jenkins  notation  the  first  three  are  referred  to  as 
(0,1,1)  X  (0,1,1),  (1,0,0)  X  (0,1,0)  and  (1,0,0)  x  (0,1,1),  respectively. 
For  the  remainder  of  the  study  these  are  referred  to  as  the  GW,  F,  and 
BR  models. 

Sample  Selection 

Data  pertaining  to  the  sample  of  264  firms  was  obtained  from  the 
Compustat  quarterly  and  CRSP  monthly  tapes.  For  a  firm  to  be  included 
in  the  sample,  it  was  required  to  have  no  missing  EPS  or  returns  data  for 
the  64  consecutive  quarters  beginning  with  the  first  quarter  of  1962. 
This  provided  a  sample  period  from  1962  through  1977.   The  EPS  number 
used  was  primary  earnings  per  share  excluding  extraordinary  items  and 
discontinued  operations  adjusted  for  capital  changes.  The  return  figure 
selected  from  CRSP  included  both  a  dividend  and  price  component. 
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Application  of  the  Forecasting  Models 

For  purposes  of  assessing  the  ILF's  of  the  4  forecast  methods,  the 

years  of  1976  and  1977  were  used  as  holdout  periods.  Therefore  the  264 

series  were  each  modeled  8  times,  once  for  each  method  using  pre  1976 

data  (56  quarters  in  the  base  period)  and  again  for  each  method  (60 

quarters  in  the  base  period)  using  all  pre  1977  data.  The  result  was 

that  each  model  made  predictions  for  the  4  quarters  in  1976  and  the  4 

quarters  of  1977.  These  quarterly  forecasts  were  aggregated  within 

each  year  to  form  annual  forecasts.  These  forecasts  represent  F    in 

(1)  above. 

Next  the  coefficients  a, .  and  3- .  in  (3)  were  estimated  for  each 

li      li 

firm.  The  procedure  was  done  for  each  hold  out  year  and  was  based  on  all 
data  prior  to  the  holdout  year.  The  market  index  was  computed  by  summing 
all  of  the  sample  firms'  EPS  except  the  one  for  which  the  model  was  being 
estimated.  The  residuals  of  the  models  were  tested  for  autocorrelation 
and  the  null  hypothesis  of  no  autocorrelation  was  rejected  for  only  8 
firms  which  was  attributed  to  chance. 

The  a.   and  S.  coefficients  were  then  applied  to  compute  the 
investors  anticipation  of  the  market  conditioned  EPS  in  (2)  and  finally 
the  anticipation  of  the  unexpected  earnings  change  in  (5) . 

Application  of  the  Market  Model 

The  market  model  (4)  was  estimated  (in  log  form)  for  each  firm 
and  for  each  of  the  two  years.  The  estimation  included  data  in  the  5 
years  preceeding  the  holdout  year.  The  residuals  from  these  models  when 
applied  to  the  two  holdout  years  constitute  abnormal  returns.  The  market 
index  used  was  the  equally  weighted  index  containing  the  dividend-price 
returns  of  all  firms  except  for  the  one  being  estimated. 
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Empirical  Results 

The  loss  for  each  forecast  method  was  calculated  by  computing  the 

annual  cummulative  abnormal  return  (CAR)  associated  with  each  forecast 

method  and  subtracting  this  from  the  CAR  associated  on  an  investment 

strategy  based  on  ex  ante  knowledge  of  the  actual  EPS.  The  CARs  were 

computed  by  assuming  a  long  investment  given  a    in  (5)  was  positive 

0 
(henceforth  CAR+)  and  a  short  investment  given  that  a    was  negative 

(henceforth  CAR-) . 

Table  1  gives  the  cummulative  abnormal  residuals  for  the  4  forecast 
methods  and  actual  EPS,  for  the  12  months  prior  to  and  including  the 
earnings  announcement  date.  Quick  inspection  reveals  that  only  the  GW  (for 
the  year  1977)  and  the  actuals  (for  the  year  1977)  demonstrate  a  strong 
apparent  pattern  of  abnormal  return.   Surprising,  however,  is  that  in 
1976  the  actuals  exhibited  virtually  no  net  abnormal  return.   In  fact 
the  1976  actual  CAR+  as  a  whole  (i.e.,  month  0)  is  of  the  wrong  sign 
though  nearly  equal  to  0. 

[Table  1  here] 

Table  2  presents  the  loss  for  each  of  the  4  methods.  Note  that  in 
all  cases  the  loss  is  positive  with  the  smallest  overall  loss  being 
associated  with  the  GW  method  and  the  largest  loss  being  associated  with 
the  BR.  Table  3  gives  the  rankings  of  each  method  where  1  denotes  the 
smallest  loss,  etc.  Note  that  the  GW  model  loss  dominates  (is  smallest) 
in  both  years. 

[Tables  2  and  3  here] 

In  order  to  assess  the  significance  of  the  differences  between  the 
losses  in  Table  2,  a  weighted  analysis  of  variance  was  done  using  a  model 
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containing  3  factors:   firm  (264  levels),  method  (4  levels)  and  year 
(2  levels) .  The  dependent  variable  was  taken  to  be  1  in  the  event  that 
a  decision  to  invest  (based  on  the  sign  of  a    in  (5))  for  a  given  firm, 
year  and  method  led  to  a  positive  market  return  and  0  otherwise. 

To  provide  useful  descriptive  statistics  and  a  feel  for  the  meaning 
of  the  weighted  ANOVA,  the  unweighted  ANOVA  cell  means  are  presented  in 
Table  4.  These  can  be  interpreted  as  the  percentage  of  times  that  a 
given  method  makes  the  correct  decision  (i.e.,  earns  a  positive  return), 
and  the  larger  the  percentage,  the  more  that  method  would  be  preferred. 
Note,  however,  that  this  percentage  measure  ignores  the  magnitude  of  the 
individual  decision  outcomes  (i.e.,  the  magnitude  of  the  abnormal  return), 
For  this  reason  a  weighted  ANOVA  was  done  where  the  means  were  computed 
on  a  weighted  basis  using  the  absolute  value  of  the  CARs  as  weights. 
The  results  are  presented  in  Table  5. 

[Tables  4  and  5  here] 
Note  that  the  mean  rankings  are  consistent  with  those  in  Table  3  and  4 
and  also  that  the  effect  of  method  is  highly  significant,  implying  that 
the  means  for  the  4  methods  are  not  eqvial.   ^ 

Since  the  method  effect  was  found  to  be  significant,  a  posteriori 

pairwise  tests  for  equality  of  means  were  made  using  Scheffe's  paired 

3 
comparison  test   [Winer,  1971].  These  results  are  given  in  Table  6  and 

indicate  that  all  possible  pairs  are  significantly  different  from  each 

other  with  the  exception  of  BR  vs  BJ. 

[Table  6  here] 
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An  Alternative  Basis  for  Comparing  Methods 

An  alternative  way  to  compare  methods  would  be  to  perform  an  Iden- 
tical AITOVA  as  above  except  let  the  dependent  equal  1  when  a  given  method 
produces  the  same  investment  decision  as  would  have  been  made  had  the 
forecasted  EPS  been  perfectly  accurate  (and  0  otherwise) .  This  approach 
evaluates  each  forecast  set  on  the  basis  of  how  frequently  the  decisions 
resulting  from  that  set  agree  with  decisions  which  would  have  been  made 
if  each  forecast  in  the  set  was  perfectly  accurate.  The  ANOVA  results 
of  using  this  approach  and  the  ANOVA  results  from  the  first  definition 
of  the  dependent  variable  should  be  consistent  to  the  degree  that  ex  ante 
knowledge  of  the  actual  produces  the  best  investment  decision.  If  ex 
ante  knowledge  of  the  actual  always  produces  the  best  investing  decision, 
then  both  definitions  are  exactly  the  same.  Also  it  seems  reasonable  to 
use  definition  two  since  the  focus  of  forecasting  is  predicting  the  actual 
EPS  and  therefore  a  method  which  perfoinns  better  in  this  respect  might 
be  preferred.  Of  course  the  acid  test  of  how  well  a  method  performs 
must  relate  the  decision  to  the  return  (definition  one)  but  in  any  given 
year  statistical  variation  might  cause  a  given  method  to  be  ranked  low 
vmder  definition  one  but  not  under  definition  two.  Therefore  one  might 
prefer  to  adopt  a  method  under  these  circumstances  on  the  assumption 
that  it  gives  better  predictions  of  actual  EPS  and  therefore  will  be 
likely  to  be  superior  under  definition  one  in  future  years. 

Table  7  presents  the  weighted  ANOVA  results  for  definition  two. 
Again  the  effect  of  method  is  highly  significant.  Note  that  the  ranks 

[Table  7  here] 
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are  essentially  the  same  with  the  exception  that  6J  and  BR  exchanged 
places,  which  does  not  seem  unreasonable  since  they  were  not  signifi- 
cantly different  in  the  first  set  of  paired  difference  tests. 

Table  8  presents  the  paired  tests  for  definition  two.  All  differ- 
ences are  significant  with  the  exception  of  GW  vs.  F.  Again  GW  and  F 
have  significantly  higher  means  than  BJ  and  BR. 

[Table  8  here] 

Summary  and  Conclusions 

Previous  research  involving  comparisons  among  forecast  methods  has 
typically  relied  on  various  error  metrics.  In  the  present  study  an  al- 
ternative approach  has  been  taken,  namely  comparing  forecast  methods 
based  on  the  outcomes  of  investment  decisions  which  depend  on  earnings 
forecasts.  In  particular  an  investor's  loss  was  defined  as:  The  dif- 
ference between  the  return  which  would  be  earned  given  perfect  knowledge 
of  the  unexpected  earnings  and  return  which  would  be  earned  based  on 
utilization  of  a  prediction  of  the  unexpected  earnings  number. 

Several  forecast  models  were  examined  based  on  their  observed  loss. 
The  results  indicated  that  the  models  studied  by  Foster  ((1,0,0)  x  (0,1,0)) 
and  Griffin  and  Watts  ((0,1,1)  x  (0,1,1))  performed  better  than  those  of 
Brown  and  Rozeff  ((1,0,0)  x  (0,1,1))  and  individually  identified  Box- 
Jenkins  models. 
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TABLE  2 
Losses  Associated  With  Each  of  the  A  Forecast  Methods 


BJ 

BR 

F 

GW       1 

1976 

1977 

1976 

1977 

1976 

1977 

1976 

1977 

Loss* 

.03497 

.05869 

.04731 

.07236 

.03506 

.05546 

.02548 

.02821 

Avg** 

.0468 

.0598 

.0453 

.0268 

*Based  on  composite  CAR 

**Average  of  CAR+,  CAR-  for  both  years. 


TABLE  3 
Forecast  Methods  Ranked  Based  on  Loss 


1976 

1977 

Average 

BJ 

2 

4 

3 

BR 

4 

3 

4 

F 

3 

2 

2 

GW 

1 

1 

1 

TABLE  4 
Unweighted  Cell  Means  for  the  Method  Factor 


Year 
1976      1977 

Overall 
Average 

Overall 
Rank 

M 
£ 
T 
H 
0 
D 

BJ 

.4432 

.5265 

.4848 

3 

BR 

.3902 

.5265 

.4432 

4 

F 

.4394 

.5341 

.4867 

2 

GW 

.4659 

.6174 

.5417 

1 

TABLE  5 
Weighted  Ai^OVA  to  Compare  Forecast  Methods 


Panel  1  (cell  means) 


197.^ 

1977 

Avg. 

Rank 

M 
E 
T 
H 
0 
D 

BJ 

.4197 

.5030 

.4604 

3 

BR 

.3807 

.5041 

.4410 

4 

F 

.4194 

.6508 

.4884 

2 

GW 

.4497 

.6522 

.5486 

1 

Panel  2  (ANOVA  Table) 


Source 
a)  Year 
(2)   Firm 
C3)  Method 

(4)  (1)  X   (3) 

(5)  (2)  X  C3) 


Demoninator   DFN 


Firm 

(2)  X  (3) 
(2)  X  (3) 


1 

526 

3 

3 

1578 


DID     MS  F 

526   1.543  18.575 

.0831 

1578    .1793  7.968 

1578    .0510  2.226 

.0225 


Prob. 
.0000 

.0000 
.0819 


TABLE  6 
Pairwise  Comparisons  Between  Individual  Methods 


Mean 

BR 
.4410 

BJ 
.4604 

F 
.4884 

GW 
.5486 

BR 
BJ 
F 

Difference  between  means 

.0194 

.0474** 

.1076** 

.028* 

.0882** 

.0602** 

*Significant  at  a  =  .05 
**Significant  at  a  =  .01 


TABLE  7 
Weighted  Analysis  of  Variance  Under  Definition  Two 


Panel  1  (cell  means) 


1Q76 

iq77 

Avg. 

'     Rank 

M 

E 
T 
H 
0 
D 

BJ 

.555 

.552 

.554 

4 

BR 

.632 

.578 

.606 

3 

F 

.701 

.575 

.640 

2 

GW 

.641 

.600 

.650 

1 

Panel  2  (ANOVA  Table) 


Source 

(1)  Year 

(2)  Firm 

(3)  Method 

(4)  (1)  X  (3) 

(5)  (2)  X  (3) 


Demoninator       DFN 


Firm 

(2)    X   (3) 
(2)   X   (3) 


1 

526 

3 

3 

1578 


DFD 
526 

1578 
1578 


MS 
.1397 
.0781 
.1529 
.0848 
.0225 


F 
1.789 

6.801 
3.77 


Prob. 
.1781 

.0002 
.0104 


TABLE  8 

Pairwise  Comparison  Between  Individual 
Means  Under  Definition  Two 


BR        BJ        F 
Mean        .554      .606     .640 

GW 
.650 

Difference  between  means 

BJ 

BR 
F 

.052** 

.086** 

.096** 

.034** 

.044** 

.01 

*Significant  at  ct  =  .01 
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NOTES 

xhe  reader  is  referred  to  the  Grossman  and  Stiglitz  [1976]  paper  for 
details  relating  to  the  assumptions  and  logic  of  their  analysis, 

2 

In  the  present  study  we  exclude  the  constant  term  based  on  the 

evidence  provided  by  Brown  and  Rozeff  [1978]  that  this  term  is  not 
significant. 

3 
Schaffer's  test  is  generally  known  to  be  the  most  conservative  of 

a  general  class  of  paired  tests  available. 
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